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December  21, 1990 

The  Honorable  David  H.  Pryor 
Chairman,  Subcommittee  on  Federal 
Services,  Tost  Office,  and  Civil  Service 
Conunittee  on  Governmental  Affairs 
United  States  Senate 


ELECTE 
JAN  2  3 1991 


Dear  Senator  Pryor: 

The  Office  of  the  Director,  Operational  Test  and  Evaluation  (dot&e), 
uses  contractor  assistance  to  support  its  oversight  responsibility  for 
opei  dtional  test  and  evaluation  (ot&e)  of  major  weapon  systems. 
Recently,  congressional  members  have  expressed  concern  that  some  of 
dot&e’s  contractors  could  have  conflicts  of  interest;  that  is,  they  could 
assess  the  operational  testing  of  the  same  weapon  systems  that  they  had 
participated  in  developing. 


In  response  to  your  request,  we  are  providing  information  on  dot&e’s  use 
of  contractors.  Our  objectives  were  to 


describe  the  nature  and  extent  of  dot&e’s  management  controls  over  con¬ 
tractor  support,  including  measures  to  address  possible  conflicts  of 
interest  under  omnibus  contracts;' 

provide  our  views  on  dot&e’s  use  of  Federally  Funded  Research  and 
Development  Centers,2  particularly  the  Institute  for  Defense  Analyses;3 
and 

determine  dot&e’s  use  of  the  Institute  during  fiscal  years  1987-89  and 
identify  any  possible  conflicts  of  interest  and  the  Institute’s  controls  to 
avoid  such  conflicts. 


Background 


Concerned  that  ot&e  was  not  receiving  sufficient  emphasis  and  indepen¬ 
dent  oversight,  the  Congress  established  dot&e  as  an  independent  test 


f  DETRgUTION  STATEMENT  A 
Approved  toj  puciic  release. 


'Omnibus  contracts  contain  a  general  statement  of  work  to  be  performed  by  contractors.  The  con¬ 
tracting  agency  develops  specific  work  orders  or  taskings  for  contractors  based  on  this  general  work 
statement. 

federally  Funded  Research  and  Development  Centers  are  privately  operated  but  publicly  funded 
under  long-term  contracts  with  federal  sponsoring  agencies. 

:lThe  Institute  for  Defense  Analyses,  a  Center  established  in  1956,  primarily  assists  the  Office  of  the 
Secretary  of  Defense,  the  Joint  Chiefs  of  Staff,  and  the  defense  agencies.  The  Institute  provides 
studies,  analyses,  computer  software,  models,  and  other  technical  or  analytical  support  for  policy  and 
program  planning  and  management  by  its  sponsors.  It  does  not  work  for  private  companies,  foreign 
governments,  or  the  military  departments. 
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organization  in  the  Office  of  the  Secretary  of  Defense  (osd).  The  Con¬ 
gress  believed  that  an  organization  with  a  vested  interest  in  a  weapon 
system’s  development  should  not  evaluate  the  operational  testing  on 
which  production  decisions  are  based.  Rather.  Congress  intended  that 
the  ot&f,  field  tests  be  assessed  by  an  independent  test  office  to  deter¬ 
mine  whether  weapon  systems  can  actually  perform  their  intended 
mission. 

Because  i)(W'  lacks  a  large  in-house  staff,  it  obtains  contractor  assis¬ 
tance  to  suppoi  l  its  oversight  of  operational  testing.  Of  its  $34.8  million 
total  budget  for  fiscal  years  1987-89,  about  90  percent,  or  $31.2  million, 
was  for  contractor  assistance.  Approximately  $12.5  million  was  obli¬ 
gated  to  the  Institute  for  Defense  Analyses,  $0.2  million  to  another 
center,  and  $18.5  million  to  private  companies.  Of  the  latter  amount, 
about  $2.1  million  was  provided  to  private  contractors  awarded  omnibus 
contracts  beginning  in  March  1989. 

dot&k’s  mission  is  to  provide  independent  assessments  of  major  defense 
systems.  However,  the  ability  to  fulfill  the  independence  mission  was 
questioned  in  a  hearing  held  on  dot&e’s  use  of  contractors  and  consul¬ 
tants  by  the  Senate  Committee  on  Governmental  Affairs,  Subcommittee 
on  Federal  Services,  Post  Office,  and  Civil  Service.  The  primary  concern 
centered  on  possible  conflicts  of  interest  for  private  contractors.  In 
response  to  this  concern,  a  dot&e  official  told  us  DOT&E  discontinued 
using  private  contractors  in  March  1990.  Since  that  time,  dot&e  has  used 
only  the  Institute  for  ot&e  assistance  because  it  believes  that  the  Insti¬ 
tute,  which  does  not  develop  or  produce  weapon  systems,  is  less  likely  to 
have  a  conflict  of  interest. 

Although  dot&e  relies  on  other  defense  agencies'  to  award  contracts,  the 
Congress  has  indicated  that  it  holds  dot&e  ult  imately  responsible  for  the 
consequences,  such  as  conflicts  of  interest,  of  any  contractor  participa¬ 
tion  in  ot&e  activities/'  dot&e  is  also  expected  to  follow  the  govern¬ 
mentwide  Federal  Acquisition  Regulation  and  applicable  Office  of 
Management  and  Budget  (omb)  guidance  on  contract  management  and 


'Due  to  the  limited  dollar  value  of  DOT&E's  contracting  sup|x>rt,  the  Defense  Test  and  Evaluation 
Support  Agency  and  Defense  Supply  Services-Washington  award  its  contracts. 

"See  the  Conference  Ke|x>rt  on  the  DOD  Authorization  Act  for  Fiscal  Years  1990  and  1991  It. Rep.  No. 
101-Til.  Page  000  ( 1989)  The  act  added  section  2399  to  It'  C.S.C.,  and  states  that  the  Director  is  not 
to  contract  with  any  ix-rson  for  advice  or  assistance  in  the  test  and  evaluation  of  a  system  in  which 
the  person  participated  in  the  development,  production,  or  testing  for  a  military  department  or 
defense  agency  (or  for  another  defense  contractor).  In  addition,  the  legislation  states  that  a  contractor 
that  has  participated  in  the  development,  production,  or  testing  of  a  system  for  a  military  department 
...”  JefeiiM  agency  is  not  to  be  involved  (in  any  way)  in  the  establishment  of  criteria  for  data  collec¬ 
tion.  performance  assessments,  or  evaluation  activities  for  o|x-rational  testing. 
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conflicts  of  interest  regarding  the  use  of  contractors.  For  example,  omb 
Policy  Letter  89-1  states  dial  the  responsibility  for  identifying  and 
preventing  potential  conflicts  of  interest  in  government  contracts  is 
shared  between  the  contracting  officer  and  the  requester  of  the  service. 


Results  in  Brief 


dome's  policies  and  procedures  for  managing  contracts  for  ot&e  support 
comply  with  existing  guidelines.  Moreover,  dome  took  measures  that 
were  consistent  with  regulations  requiring  agencies  to  guard  against 
contractors’  conflicts  of  interest.  For  example,  dome  evaluated  the 
omnibus  contracts  for  possible  conflicts  of  interest  and  inserted  lan¬ 
guage  in  contracts  requiring  the  contractors  to  disclose  any  conflicts. 

Because  a  federal  agency  has  considerable  latitude  in  placing  work  with 
Federally  Funded  Research  and  Development  Centers,  dome's  use  of  the 
Institute  for  ot&e  support  is  permissible  under  federal  regulations.  Fur¬ 
ther,  in  our  opinion,  dome's  use  of  the  Institute  is  appropriate  because 
the  Institute  is  less  likely  than  private  contractors  to  have  conflicts  of 
interest. 

Of  the  $12.5  million  obligated  by  dome  to  the  Institute  during  fiscal 
years  1987-89,  about  $2  million  was  used  for  consultant  and  subcon¬ 
tractor  support.  The  Institute’s  policy  is  not  to  employ  consultants  on 
tasks  that  could  result  in  a  conflict  of  interest.  However,  based  on  avail¬ 
able  information,  we  identified  three  consultants  that  were  involved  in 
defense  programs  and  later  made  operational  test  assessments  for  the 
Institute  on  the  same  programs.  We  have  no  basis  to  conclude  that  the 
consultants’  prior  work  affected  their  ability  to  provide  objective  and 
impartial  advice.  These  situations  raise  questions,  however,  about  the 
effectiveness  of  the  Institute’s  controls  over  consultants  because  it  did 
not  periodically  update  its  conflict-of-interest  reviews  of  consultants  or 
disclose  to  dot&e  possible  conflicts  so  that  they  could  be  addressed.  Even 
though  the  Institute’s  contract  and  Federal  Acquisition  Regulation  do 
not  require  disclosure  of  a  consultant’s  prior  work,  we  believe  such  dis¬ 
closure  would  be  consistent  with  the  regulation  requiring  disclosure  of  a 
center’s  affairs. 

The  Institute’s  work  for  osd  organizations  responsible  for  system  acqui¬ 
sition  and  development  testing  raises  questions  regarding  its  ability  to 
be  fully  objective  in  performing  operational  testing  work  for  dot&e.  We 
found  four  instances  in  which  the  Institute’s  objectivity  may  have  been 
impaired  due  to  its  acquisition  and  development  work.  Although  the 
Federal  Acquisition  Regulation  docs  not  :i  quire  the  disclosure  of  such 
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circumstances,  we  believe  that  full  disclosure  to  dot&e  would  have  been 
consistent  with  the  spirit  of  the  regulation. 

A  detailed  discussion  of  these  matters  is  included  in  appendix  I. 


Conclusion  and 
Recommendation 


The  Institute  is  not  now  required  to  disclose  to  dot&e  possible  conflicts 
of  interest  arising  from  (1)  its  work  for  osd  organizations  responsible  for 
system  acquisitions  and  development  testing  or  (2)  its  use  of  consul¬ 
tants.  Nonetheless,  we  believe  that  such  disclosure  to  dot&e  would  be 
consistent  with  the  Federal  Acquisition  Regulation  requiring  disclosure 
of  the  Institute’s  affairs.  Accordingly,  we  recommend  that  dot&e  require 
the  Institute  to  disclose  possible  conflicts  of  interest  to  it  for  resolution 
because  dot&e  is  ultimately  responsible  for  the  consequences  of  any  con¬ 
tractor  participation  in  ot&e  activities. 


Scope  and 
Methodology 


Our  fieldwork  was  performed  at  various  sites  in  the  Washington,  D.C., 
metropolitan  area,  including  the  offices  of  dot&e  and  the  Institute. 

We  reviewed  applicable  legislation,  regulations,  policy  letters,  and 
dot&e’s  contract  management  guidelines  and  interviewed  dot&e  officials 
about  their  controls  over  contractor  support.  Since  the  request  focused 
on  dot&e’s  use  of  omnibus  contracts  to  supplement  its  in-house  capabili¬ 
ties,  we  focused  on  dot&e’s  conflict-of-interest  controls  over  those  con¬ 
tracts.  We  did  not  evaluate  conflict-of-interest  controls  over  other 
private  contractors. 

Our  views  on  dot&e’s  use  of  the  Institute  are,  in  large  measure,  based  on 
past  reports  that  dealt  with  establishing  and  using  Federally  Funded 
Research  and  Development  Centers.  However,  to  identify  any  potential 
conflicts  of  interest  at  the  Institute,  we  reviewed  all  10  task  orders  spon¬ 
sored  by  the  Deputy  Director  Defense  Research  and  Engineering  (Test 
and  Evaluation)  during  fiscal  years  1987-89  and  information  on  1 13  out 
of  145  task  orders  sponsored  by  the  Under  Secretary  of  Defense  for 
Acquisition  during  fiscal  years  1988-89.'1  Our  objective  was  to  determine 
which  of  these  task  orders  included  systems  that  were  also  included  in 
all  the  42  task  orders  sponsored  by  dot&e.  We  then  interviewed  officials 
regarding  the  scope  of  selected  task  orders  and,  where  necessary, 
reviewed  the  Institute’s  work  products. 


r,At  the  time  of  our  review,  .12  task  orders  were  not  available. 
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We  reviewed  dot&e’s  contracts,  taskings,  and  funding  documents  con¬ 
cerning  its  relationship  with  the  Institute.  We  also  obtained  lists  of  the 
Institute’s  consultants  and  subcontractors  and  reviewed  available  data 
on  organizational  business  ties  and  controls  in  place  to  address  conflicts 
of  interest.  The  term  “conflict  of  interest”  means  any  situation  in  which 
a  person  or  organization  is  unable  or  potentially  unable  to  voder  impar¬ 
tial  advice  because  of  prior  work,  other  activities,  or  relationships.  W< 
did  not  evaluate  whether  the  consultants  or  subcontractors  had  finan¬ 
cial  interests  that  could  result  in  conflicts  of  interest. 

We  performed  this  review  between  September  1989  and  September  1990 
in  accordance  with  generally  accepted  government  auditing  standards. 
We  did  not  obtain  written  agency  comments.  How'  rer,  the  views  of 
agency  officials  were  sought  during  the  course  of  our  work  and  are 
incorporated  where  appropriate. 


As  requested,  we  plan  no  further  distribution  of  this  report  until  30 
days  after  its  issue  date,  unless  you  publicly  announce  its  contents  ear¬ 
lier.  At  that  time,  we  will  send  copies  to  the  Secretaries  of  Defense,  the 
Navy,  the  Army,  and  the  Air  Force  and  to  interested  congressional  com¬ 
mittees.  Copies  will  also  be  made  available  to  others  on  request. 

Please  contact  me  at  (202)  275-8400  if  you  or  your  staff  have  any  ques¬ 
tions  concerning  this  report.  Major  contributors  to  this  report  are  listed 
in  appendix  II. 


Sincerely  yours, 


Paul  F.  Math 

Director,  Research,  Development, 
Acquisition,  and  Procurement  Issues 
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DOT&E’s  Use  of  Private  Contractors  and  the 
Institute  for  Defense  Analyses 


DOT&E’s  Controls 
Over  Contractor 
Support 


In  obtaining  assistance  and  advisory  services,  dot&e  uses  the  required 
controls  over  both  contract  management  and  conflicts  of  interest,  as  dis¬ 
cussed  below. 


Management  Controls  Meet 
OMB  Requirements 


dot&e’s  contract  management  control  system  is  consistent  with  proce¬ 
dures  prescribed  by  “omb  Circular  No.  A-120.”1  The  circular  requires, 
among  other  things,  that  (1)  written  approval  for  advisory  and  assis¬ 
tance  services  be  required  at  a  level  above  the  organization  sponsoring 
the  activity,  (2)  requirements  be  appropriate  and  fully  justified  in 
writing,  (3)  work  statements  be  specific  and  complete,  (4)  contracts  be 
competitively  awarded,  (5)  work  be  properly  administered  and  moni¬ 
tored,  (6)  work  be  evaluated  when  completed,  and  (7)  written  reports  on 
advisory  and  assistance  services  be  obtained  when  needed.  As  summa¬ 
rized  below  and  on  succeeding  pages,  we  found  that  dot&e’s  contract 
management  process  meets  these  requirements. 


•  To  initiate  contractor  assistance,  a  dot&e  staff  member  and  the  dot&e 
Program  Analyst,  who  is  responsible  for  dot&e’s  overall  funding,  draft  a 
task  order  defining  the  scope  and  need  for  contractor  support.  The 
Deputy  Director,  Resources  and  Administration,  responsible  for  dot&e’s 
contractor  assistance,  reviews  the  work  statement  and  decides  whether 
to  proceed  with  the  work  request.  For  all  work  requests,  a  review  board 
consisting  of  dot&e’s  deputy  directors  decides  whether  to  contract  for 
the  proposed  work. 

•  dot&e’s  Program  Analyst  maintains  monthly  financial  statements  that 
track  obligations  by  task  order.  The  financial  statements  are  designed  to 
ensure  that  dot&e  does  not  over  obligate  funds. 

•  The  larger  contractors  provide  dot&e  monthly  status  reports  which  it 
evaluates  and  uses  to  track  contract  status  and  costs. 

•  When  a  work  request  is  reported  as  having  been  completed,  the  con¬ 
tracting  officer’s  technical  representative  consults  with  the  dot&e  staff 
member  who  initiated  the  work  and  reviews  the  monthly  status  reports 
to  determine  whether  the  work  has  actually  been  completed.  Also,  the 
OSD  Director  of  Contractor  Assistance  and  Advisory  Services  helps  to 
ensure  that  the  proper  process  is  followed  in  determining  whether  the 
contractor  support  was  adequate. 

•  To  document  the  use  of  contractor  assistance,  the  dot&e  Program  Ana¬ 
lyst  and  the  contracting  officer’s  technical  representative  maintain  log 


‘Guidelines  for  the  Use  of  Advisory  and  Assistance  Services  (Jan.  4,  1988). 
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books  consisting  of  task  orders  and  supporting  records  for  the  larger 
contracts. 


Controls  Established  by 
DOT&E  Adhered  to 
Regulations 


Before  it  began  obtaining  ar&E  support  exclusively  from  the  Institute, 
ixjt&e  had  controls  in  place  to  guard  against  possible  conflicts  of  interest 
on  omnibus  contracts.  These  controls  adhered  to  the  Federal  Acquisition 
Regulation,  which  states  that  agencies  should  prevent  conflicts  of 
interest  that  could  result  in  an  unfair  competitive  advantage  to  a  con¬ 
tractor  or  impair  a  contractor's  objectivity  in  performing  contract  work. 
Therefore,  as  required  by  the  regulation,  dot&e  evaluated  the  omnibus 
contracts  to  ( 1 )  identify  and  evaluate  potential  conflicts  of  interest  early 
in  the  acquisition  process  and  (2)  avoid,  neutralize,  or  mitigate  signifi¬ 
cant  conflicts  before  contract  award. - 

dot&e  further  attempted  to  prevent  conflicts  of  interest  by  inserting  a 
provision  in  the  contracts  requiring  contractors  to  self-disclose  potential 
conflicts  and  eliminate  them.  For  example,  contractors  were  required  to 
evaluate  whether  the  work  to  be  done  for  dot&e  conflicted  with  work 
being  done  for  other  organizations.  In  addition,  a  dot&e  official  said  that 
based  on  past  experiences,  dot&e  was  generally  aware  of  a  contractor’s 
business  ties  and  has  tried  to  avoid  giving  contractors  work  that  could 
result  in  a  conflict  of  interest.  For  example,  one  contractor  was  not  given 
work  on  space  systems  because  the  contractor’s  prior  business  had  the 
potential  of  creating  a  conflict. 

In  June  1989,  the  Senate  Committee  on  Governmental  Affairs,  Subcom¬ 
mittee  on  Federal  Services,  Post  Office,  and  Civil  Service,  held  a  hearing 
on  dot&e’s  use  of  contractors  and  consultants.  The  Subcommittee 
released  a  report  which  found  that  private  contractors’  work  for  the 
Department  of  Defense  raised  concerns  of  both  direct  and  indirect  con¬ 
flicts  of  interest.  Direct  conflicts  of  interest  resulted  from  the  omnibus 
contractors  monitoring  and  assessing  operational  tests  of  weapon  sys¬ 
tems  that  they  participated  in  developing.  In  addition,  indirect  conflicts 
of  interest  could  result  from  their  relationships  with  other  private  con¬ 
tractors  that  developed  weapon  systems  that  the  contractors  would 
later  assist  dot&e  in  evaluating.  Recause  dot&e  discontinued  this  practice 


According  to  the  Federal  Acquisition  Regulation,  each  contracting  situation  should  be  examined  on 
the  basis  of  its  particular  facts  and  the  nature  of  the  proposed  contract.  The  exercise  of  common 
sense,  good  judgment,  and  sound  discretion  is  required  in  deciding  whether  a  significant  potential 
conflict  exists  and,  if  it  does,  in  developing  an  appropriate  means  for  resolving  it. 
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in  March  1990,  we  did  not  evaluate  whether  its  use  of  these  private  con¬ 
tractors  would  result  in  conflicts  of  interest.  Instead,  we  focused  our 
attention  on  ixxr&E's  stile  use  of  the  Institute  for  obtaining  oiwk  support. 


Appropriateness  of 
DOT&E’s  Use  of  the 
Institute 


ixjt&k  now  uses  only  the  Institute  for  trr&K  support.  ixtr&i:  believes  that 
this  practice  is  appropriate  because  the  Institute  is  thought  to  be  less 
likely  than  private  contractors  to  have  a  conflict  of  interest  concerning 
particular  weapon  systems.  We  agree.  1’nder  its  charter,  the  Institute 
has  no  commercial  interests  in  developing  weapon  systems  and  may  not 
work  for  the  services  that  could  develop  and  use  those  systems. 

In  addition,  ixjt&k’s  use  of  the  Institute  is  consistent  with  govern¬ 
mentwide  regulations  issued  as  Policy  Letter  84-1  by  the  Office  of  Fed¬ 
eral  Procurement  Policy  and  later  incorporated  into  the  Federal 
Acquisition  Regulation.  The  regulation  states  that  Federally  Funded 
Research  and  Development  Centers  must  meet  some  special  long-term 
research  or  development  need  that  cannot  be  met  as  effectively  by 
existing  in-house  or  contractor  resources.  In  March  1988.  we  reported 
that  centers  are  effective  because  of  their  expertise  and  independence 
and  because  they  have  a  special  relationship,  including  the  sharing  of 
information,  with  their  sponsoring  agency.11 

Also,  the  policy  letter  specifies  that  a  center's  purpose,  mission,  and  gen¬ 
eral  scope  of  effort  should  be  stated  clearly  enough  to  differentiate 
between  work  that  should  be  done  by  the  center  and  that  which  should 
be  done  by  private  contractors.  The  policy  letter,  however,  does  not 
state  how  these  mission  statements  should  reflect  such  differentiation. 
According  to  the  Institute’s  mission  statement,  its  purpose  is  to  promote 
national  security,  public  welfare,  and  advancement  of  scientific 
learning.  Its  scope  of  effort  typically  covers  analyses,  evaluations,  and 
reports,  including  the  examination  of  the  relative  effectiveness  of  alter¬ 
native  national  security  measures.  Thus,  under  federal  regulations  and 
the  Institute's  mission  statement,  ixrr&K  has  considerable  latitude  in 
placing  work  with  the  Institute. 


The  Institute’s  Work 
for  DOT&E 


The  Institute’s  relationship  with  IXJI’&E  is  governed  by  Policv  letter  84-1 
and  the  Federal  Acquisition  Regulation,  which  set  out  Federal  policy  for 
establishing  and  using  Federally  Funded  Research  and  Development 


'Competition:  Issues  on  Establishing  and  Using  Federally  Funded  Researc  h  and  Development  Centers 

( flAWSSIAWW-SS.  Mar  1988  >  - - ' - 
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The  Institute’s  Controls 
Over  Consultant/ 
Subcontractor  Conflicts  of 
Interest  Have  Weaknesses 


Coasultant  Controls 


Centers.  The  Federal  Acquisition  Regulation  reinforces  Policy  Letter 
84-1  by  stating  that  a  center  is  required  to  conduct  its  business  in  a 
manner  befitting  its  special  relationship  with  the  government,  operate  in 
the  public  interest  with  objectivity  and  independence,  be  free  from  orga¬ 
nizational  conflicts  of  interest,  and  have  full  disclosure  of  its  affairs  to 
the  sponsoring  agency.  The  Institute  has  controls  to  ensure  that 

its  consultants  and  subcontractors4  do  not  have  previous  or  current 
employment  that  could  result  in  conflicts  of  interest  and 
its  work  for  osd  organizations  responsible  for  weapon  systems  acquisi¬ 
tion  and  development  testing  does  not  conflict  with  its  operational 
testing  wrork  for  dot&k. 

As  discussed  below,  we  question  whether  the  Institute  is  completely 
effective  in  administering  these  controls.  In  addition,  we  believe  the  con¬ 
trols  can  be  improved  by  having  the  Institute  disclose  possible  conflicts 
to  dot&e  for  resolution  because  dome  is  ultimately  responsible  for  the 
consequences  of  any  contractor  participation  in  (tt&e  activities.  Such  dis¬ 
closure  to  oar&E  would  be  consistent  with  the  Federal  /-quisition 
Regulation. 


Of  the  $12.5  million  obligated  by  dot&e  to  the  Institute  during  fiscal 
years  1987-89,  about  $2  million  was  paid  to  51  consultants  and  2  sub¬ 
contractors.  (The  Institute’s  use  of  consultants  and  subcontractors  as  a 
percentage  of  its  work  for  rxtr&E  declined  from  24.4  to  12.3  percent  over 
this  period.)  Based  on  available  information,  we  believe  these  consul¬ 
tants/subcontractors  did  not  have  other  current  employment  that  could 
cause  conflicts  of  interest.  However,  the  Institute  did  not  periodically 
update  its  conflict-of-interest  reviews  of  consultants  or  disclose  to  ix.rr&K 
any  prior  employment  of  the  consultants  that  might  have  involved 
potential  conflicts.  Further,  the  Institute  did  not  document  its  subcon¬ 
tractor  conflict-of-interest  reviews. 

The  Institute’s  policy  is  not  to  employ  consultants  on  jobs  that  could 
result  in  a  conflict  of  interest.  For  example,  a  consultant  would  not  be 
allowed  to  do  ot&k  work  on  a  weapon  system  if  the  consultant  was  also 
working  for  the  developer  of  the  same  weapon  system.  To  carry  out  this 
policy,  the  Institute  requires  its  consultants  to  sign  an  agreement  stating 


4 According  to  an  Institute  official,  a  consultant  is  an  individual  who  agrees  to  work  for  the  Institute 
as  needed  a.  an  agreed-upon  hourly  rate.  A  subcontractor  is  an  incorporati-d  entity  that  works  a 
specified  number  of  hours  for  the  Institute. 
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that  they  will  (1)  avoid  any  activities  that  cause  conflicts  of  interest  and 
(2)  disclose  possible  conflicts  so  that  the  Institute  may  exclude  them 
from  such  work.  Before  hiring  consultants,  the  Institute  asks  about  their 
backgrounds  to  determine  whether  any  of  their  past  or  present  business 
activities  could  cause  a  conflict.  However,  the  Instit  ite  does  not  periodi¬ 
cally  update  information  about  its  consultants’  business  ties  or  other 
employment  after  they  are  hired;  therefore,  a  new  business  tie  could 
arise  and  create  a  potential  conflict  of  interest,  and  the  Institute  might 
not  know  about  it. 

Of  the  51  consultants  hired  by  the  Institute,  2  had  played  a  role  in  over¬ 
seeing  the  services’  space  programs  before  they  did  operational  test 
assessments  on  such  programs  for  dot&e.  The  Institute  was  aware  of 
these  consultants’  prior  work  experiences  but  did  not  disclose  this  infor¬ 
mation  to  dot&e  because  it  was  satisfied  that  no  conflict  of  interest  was 
created.  One  consultant  previously  worked  for  the  Air  Force  in  a  high- 
level  policy  position  involving  space  systems  and  later  planned  and 
reviewed  the  Institute’s  OT&e  assessments  of  various  Air  Force  space 
systems.  The  other  consultant  headed  the  Naval  Space  System  Division 
in  the  Office  of  the  Chief  of  Naval  Operations  and  later  evaluated  the 
Institute’s  ot&e  assessments  of  a  Navy  weapon  system  that  was  to  pro¬ 
ceed  into  full-rate  production.  While  we  have  no  basis  to  conclude  that 
the  consultants’  prior  work  affected  their  ability  to  provide  objective 
and  impartial  advice,  these  situations  nonetheless  raise  questions  about 
potential  conflicts  of  interest  and  the  performance  of  the  Institute  in 
administering  pertinent  controls.  Considering  the  consultants’  prior  gov¬ 
ernment  positions  and  their  work  for  the  Institute,  we  believe  the  Insti¬ 
tute  should  have  disclosed  these  situations  to  dot&e  for  resolution. 
Although  the  Institute’s  contract5  and  the  Federal  Acquisition  Regula¬ 
tion  do  not  specifically  require  the  disclosure  of  a  consultant’s  past  and 
present  employment,  we  further  believe  that  such  disclosure  would  have 
been  consistent  with  the  regulation  requiring  disclosure  of  a  center’s 
affairs  to  the  sponsoring  agency. 

In  another  situation,  a  consultant  performed  work  on  the  LHX  heli¬ 
copter  for  a  private  company  prior  to  performing  ot&e  related  work  on 
this  system.  The  work  for  the  private  company  included  evaluating  the 
requirement  for  the  helicopter  as  well  ns  a  general  developmental 


r’The  Institute’s  contract  states  that  it  shall  subn.it  quarterly  the  names  of  all  consultants  employed 
during  the  period,  a  short  statement  of  the  matters  on  which  the  consultant's  advice  or  service  was 
needed,  the  daily  rate  of  compensation,  and  the  period  for  which  service  was  required. 
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approach.  The  private  company  later  prepared  a  proposal  for  a  con¬ 
tractor  that  was  awarded  a  development  contract.  The  Institute  was 
aware  of  this  consultant’s  prior  work  experiences  but  did  not  disclose 
this  information  to  dot&e  because  it  was  satisfied  that  no  conflict  of 
interest  was  created.  Although  we  have  no  basis  to  conclude  that  the 
consultant’s  prior  work  for  the  private  company  affected  the  con¬ 
sultant’s  ability  to  provide  objective  and  impartial  advice  to  the  Insti¬ 
tute,  this  situation  again  demonstrates  a  need  for  disclosure  of  such 
potential  conflicts  to  dot&e.  For  reasons  similar  to  the  above  situations, 
disclosure  of  this  matter  to  dot&e  for  resolution  would  have  been  consis¬ 
tent  with  the  regulation. 

An  Institute  official  told  us  that  more  attention  will  be  given  to  con¬ 
sultant’s  work  in  relation  to  specific  areas  of  prior  employment. 

Subcontractor  Controls  Although  we  were  advised  that  the  Institute  also  assessed  whether 

hiring  a  subcontractor  would  cause  a  conflict  of  interest,  it  did  not  docu¬ 
ment  such  assessments.  Despite  this  shortcoming,  the  Institute’s  two 
subcontractors  did  not  appear  to  have  past  or  present  employment  tl  at 
would  affect  their  objectivity. 

We  reviewed  the  outside  ties  of  the  subcontractor  that  received  over 
$852,000,  or  about  99  percent  of  the  funds  that  the  Institute  paid  to 
subcontractors  from  1987  to  1989.  Although  the  subcontractor  worked 
for  both  the  Institute  and  the  Air  Force  in  the  chemical  warfare  area,  its 
work  for  the  two  organizations  differed.  The  subcontractor  performed 
policy  analyses  and  studies  for  the  Institute  as  part  of  its  dot&e  work 
regarding  how  and  when  the  United  States  should  retaliate  if  the  Soviets 
were  to  use  chemical  weapons.  For  the  Air  Force,  the  subcontractor 
assessed  chemical  contamination  avoidance  and  decontamination  proce¬ 
dures  and  chemical  defenses  against  a  Soviet  chemical  threat. 


The  Institute’s  Work  for 
Other  OSD  Organizations 
Raises  Questions  About  Its 
Objectivity 


The  Institute’s  work  for  the  osd  organizations  responsible  for  system 
acquisition  and  development  testing  raises  questions  regarding  its 
ability  to  be  fully  objective  in  performing  operational  testing  work  for 
dot&e.  In  three  instances,  we  found  that  the  Institute  performed  acquisi¬ 
tion  and  operational  testing  work  on  the  same  weapon  systems.  In  one 
other  instance,  the  Institute  performed  similar  development  and  opera¬ 
tional  testing  work  on  the  same  system.  Even  though  the  Federal  Acqui¬ 
sition  Regulation  does  not  require  the  disclosure  of  such  instances,  we 
believe  disclosure  to  dot&e  for  resolution  would  have  been  consistent 
with  the  regulation. 
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In  fiscal  years  1988-89,  the  Under  Secretary  of  Defense  for  Acquisition, 
who  is  responsible  for  the  weapon  system  acquisition  policy,  including 
development  testing,  sponsored  task  orders  for  the  Institute.  In 
reviewing  information  on  1 13  of  these  task  orders  and  all  42  task  orders 
sponsored  by  dot&e,  we  identified  3  sets  of  task  orders  relating  to  both 
acquisition  and  operational  testing  tasks  for  the  same  weapon  systems. 
The  Institute’s  work  for  the  Under  Secretary  called  for  assessing  alter¬ 
native  candidates  to  perform  a  specified  mission,  while  the  work  for 
dot&e  required  creation  of  methodologies  for  operational  test  planning 
and  assessment  of  test  results.  Although  the  Institute  personnel  per¬ 
forming  acquisition  work  do  not  perform  operational  testing  work  on  the 
same  weapon  systems,  we  believe  the  Institute’s  work  in  assessing  these 
candidates  should  be  disclosed  to  dot&e  for  possible  resolution. 

For  example,  in  one  case,  the  Institute’s  work  for  the  Under  Secretary 
required  the  identification  of  capabilities  and  the  appropriateness  of 
various  aircraft  in  satisfying  the  Army’s  scout,  attack,  and  assault  mis¬ 
sions.  This  analysis  included  assessing  the  technical  and  operational 
advantages  and  disadvantages  of  various  competing  candidates, 
including  modified  Apache  helicopters,  various  tilt  rotor  aircraft,  and 
light  helicopter  weapon  systems.  For  dot&e,  the  Institute  will  assess 
operational  test  functions  on  the  light  helicopter  weapon  system  ulti¬ 
mately  selected,  including  the  review  of  test  plans,  monitoring  of 
ongoing  testing,  and  making  recommendations  on  the  test  program.  We 
believe  that  the  Institute’s  work  in  developing  acquisition  options  for 
the  Under  Secretary  raises  questions  about  its  ability  to  be  fully  objec¬ 
tive  in  assessing  operational  test  matters  for  the  system  eventually 
selected. 

We  also  compared  the  42  task  orders  sponsored  by  dot&e  with  the  10 
task  orders  sponsored  by  the  Deputy  Director  Defense  Research  and 
Engineering  (Test  and  Evaluation),  osd’s  development  test  organization. 
The  Institute’s  personnel  worked  for  both  the  Deputy  Director  and  dot&e 
on  nine  weapon  systems. A  potential  conflict  generally  was  not  created 
because  the  types  of  work  were  different.  For  example,  the  Institute’s 
work  on  the  Army  Tactical  Missile  System  for  the  development  test 
organization  identified  a  generic  methodology  to  be  used  by  the  develop¬ 
ment  tester  in  evaluating  weapon  systems,  while  the  Institute's  work  for 


'’During  the  course  of  our  evaluation,  the  Institute's  personnel  working  in  its  Operational  Evaluation 
Division  performed  development  and  operational  testing  related  work.  They  were  not  organization¬ 
ally  separated  from  one  another. 
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DOT&E  evaluated  the  adequacy  of  the  actual  operational  testing  on  that 
specific  system. 

As  another  example,  the  Institute’s  work  on  the  Advanced  Medium 
Range  Air-to-Air  Missile  for  the  Director,  Live  Fire  Testing,  examined  an 
approach  for  conducting  live  fire  testing.  Live  fire  testing  is  used  to 
determine  the  physical  vulnerability  of  selected  U.S.  aircraft  and  armor 
systems  to  enemy  weapons,  and  the  lethality  of  U.S.  weapons  against 
selected  enemy  aircraft  and  armor  systems.  On  the  other  hand,  the  Insti¬ 
tute’s  work  for  dot&e  was  fundamentally  different  because  it  evaluated 
the  adequacy  of  the  operational  testing  on  that  specific  missile  by 
assisting  in  the  evaluation  of  the  missile’s  operational  effectiveness  and 
suitability  in  a  realistic  environment.  In  our  view,  the  Institute’s  work 
for  the  Director,  Live  Fire  Testing,  does  not  conflict  with  its  work  for 
dot&e  because  the  nature  and  types  of  work  were  very  different. 
Although  live  fire  testing  complements  operational  testing,  this  special¬ 
ized  form  of  testing  focuses  on  a  system’s  vulnerability  and  lethality. 

In  one  case,  however,  involving  the  Forward  Army  Air  Defense  weapon 
system,  the  Institute’s  personnel  working  on  development  and  opera¬ 
tional  testing  performed  essentially  the  same  tasks.  The  tasks  included 
identifying  issues,  objectives,  and  threats  that  should  be  addressed  in 
testing;  reviewing  and  monitoring  the  Army's  plans  and  preparations  for 
testing;  observing  the  conduct  of  the  tests;  and  assisting  in  the  analyses 
of  all  test  phases.  In  our  view,  performance  of  work  by  the  Institute  in 
the  development  test  phase  could  impair  the  Institute’s  ability  to  be 
completely  objective  in  performing  essentially  the  same  work  regarding 
operational  testing.  Nevertheless,  the  Institute’s  development  testing 
work  ended  in  1987  because  osd  believed  dot&e  was  the  most  appro¬ 
priate  sponsor  for  the  task. 

In  response  to  our  preliminary  findings,  an  Institute  official  stated  that 
its  Operational  Evaluation  Division  will  not  undertake  tasks  related  to 
systems  and  programs  over  which  dot&e  has  oversight  responsibilities 
for  any  sponsor  other  than  dot&e  and  the  Director  of  Live  Fire  Testing. 
With  the  exception  of  tasks  relating  to  live  fire  testing,  the  Institute  will 
not  perform  development  testing  work  for  the  Deputy  Director  Defense 
Research  and  Engineering  (Test  and  Evaluation).  Additionally,  no  Insti¬ 
tute  research  staff  member  or  consultant  may  be  assigned  to  an  opera¬ 
tional  test  and  evaluation  task  for  dot&e  if  that  staff  member  or 
consultant,  subsequent  to  the  establishment  of  the  Office  of  dot&e,  has 
participated  in  the  evaluation  or  analysis  of  that  system  as  part  of  an 
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Institute  task  for  any  sponsor  other  than  dot&e  and  the  Director  of  Live 
Fire  Testing. 
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